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ORIGINAL ARTICLE 

Modeling Alzheimer's Disease Progression Using Disease 
Onset Time and Disease Trajectory Concepts Applied to 
CDR-SOB Scores From ADNI 

I Delor 1 , J-E Charoin 2 , R Gieschke 2 , S Retout 2 and P Jacqmin 1 ; for the Alzheimer's Disease Neuroimaging Initiative 

Disease-onset time (DOT) and disease trajectory concepts were applied to derive an Alzheimer's disease (AD) progression 
population model using the clinical dementia rating scale— sum of boxes (CDR-SOB) from the AD neuroimaging initiative 
(ADNI) database. The model enabled the estimation of a DOT and a disease trajectory for each patient. The model also allowed 
distinguishing fast and slow-progressing subpopulations according to the functional assessment questionnaire, normalized 
hippocampal volume, and CDR-SOB score at study entry. On the basis of these prognostic factors, 81% of the mild cognitive 
impairment (MCI) subjects could correctly be assigned to slow or fast progressers, and 77% of MCI to AD conversions could 
be predicted whereas the model described correctly 84% of the conversions. Finally, synchronization of the biomarker-time 
profiles on estimated individual DOT virtually expanded the population observation period from 3 to 8 years. DOT-disease 
trajectory model is a powerful approach that could be applied to many progressive diseases. 
CPT: Pharmacometrics & Systems Pharmacology (2013) 2, e78; doi:1 0.1 038/psp.201 3.54; published online 2 October 2013 



Alzheimer's disease (AD), the most common dementing ill- 
ness in the elderly, is a major growing public health issue 
as life expectancy increases. AD is characterized by a slow 
decline in cognitive and functional ability assessed by vari- 
ous clinical, biochemical, imaging, and genetic biomarkers. 
However, the large variability in disease progression among 
individuals, from normal to prodromal (predementia), mild 
cognitive impairment (MCI), and dementia, 1 hinders a cor- 
rect prognosis of the disease and associated assessment 
of treatment effects of new disease-modifying drugs. An effi- 
cient way to comprehensively integrate and use the available 
information is through population disease progression mod- 
eling. In this context, the AD neuroimaging initiative (ADNI), 2 3 
an on-going longitudinal natural long-term history study 
of elderly designed to collect validated data such as MRI 
and PET images, cerebral spinal fluid and blood biomark- 
ers together with clinical/cognitive measurements in normal 
subjects (NL), MCI, and AD is a first and important step in 
the early detection and tracking of AD. Different groups have 
already published disease progression models for cognitive 
deterioration based on ADNI data. 4-7 These models, briefly 
summarized hereunder, are mainly based on the longitudi- 
nal response in AD assessment scale-cognitive subscale 
(ADAS-cog). 

On the basis of the mixed effects modeling approach, 
Ito 3 developed a linear AD progression model throughout 
all populations (i.e., NL, MCI, and AD), in which ADAS-cog 
evolved over time with a constant progression rate. In this 
model, the progression rate was shown to be influenced by 
baseline ADAS-cog, age, apolipoprotein (APOE) e4 geno- 
type, and sex. Samtani built separate nonlinear mixed effect 
models for AD 4 or MCI 5 populations using logistic models. In 



those models, ADAS-cog score deteriorated slowly during 
the early stage of the disease and more rapidly during the 
middle stage. Disease progression rates were shown to be 
mainly influenced by Trail B test, APOE e4 genotype and high 
cholesterol (or high p-tau 181p /Ap1-42 ratio), whereas high 
ADAS-cog baseline values were associated with atrophy of 
hippocampal volumes (HIPV). Moreover, based on ADAS-cog 
baseline levels and progression rates, Samtani's model iden- 
tified two subpopulations of MCI patients (MCI progressers 
and nonprogressers) which correlated rather well with patho- 
logic cerebrospinal fluid biomarker signature (high p-tau 181p 
and low Api-42) as reported by Meyer. 8 Finally, Yang, 6 being 
aware that the duration of clinical trials are too short to show 
significant changes in biomarkers, judiciously proposed to 
calculate a time shift for observed ADAS-cog scores across 
subjects and populations leading to an optimal fit of resulting 
scores to a theoretical curve of the disease progression. Sub- 
sequently, they mapped changes in biomarker data accord- 
ing to their new disease timeline. 

However, even if these analyses have brought significant 
advancement in quantitative understanding of disease pro- 
gression and in the impact of important covariates, a better 
understanding of the evolution of individuals at the prodro- 
mal phase of AD, i.e., with presymptomatic or mild signs 
of dementia, remains crucial as they are a high-risk group 
likely to benefit from effective treatments. In that context, it 
appears that the clinical dementia rating scale sum of boxes 
(CDR-SOB) score could be a valuable candidate as outcome 
indicator in prodromal/MCI populations and facilitate assess- 
ment of active vs. placebo treatment. 

CDR-SOB is commonly used to asses both cognitive and 
functional impairment of AD. It has been shown to be less 



1 Life Sciences Services, SGS Exprimo NV, Mechelen, Belgium; 2 Pharma Research and Early Development, Clinical Pharmacology, F. Hoffmann-La Roche, Basel, 
Switzerland. Correspondence: P Jacqmin (philippe.jacqmin@exprimo.com) 

Received 6 June 2013; accepted 19 August 2013; advance online publication 2 October 2013. doi:1 0.1 038/psp.201 3.54 



Disease Onset Time and Trajectory in Alzheimer's 

Delor etal 



variable than ADAS-cog, to have excellent 2-year respon- 
siveness and to be appropriate in distinguishing between 
MCI and AD patients. 9 

The objective of this work is to develop an original natu- 
ral history population disease progression model based on 
CDR-SOB scores from ADNI by integrating the experiences 
from previous ADAS-cog modeling. The model presented 
herein, similarly to Yang's model, 6 is based on the concept 
that study entry time does not correspond to the start of the 
disease as illustrated in Figure 1. Analyzing the data at the 
population level permits derivation of the most likely common 
disease trajectory using time scale adjustment and back- and 
forth extrapolation between AD and MCI patients. In addition, 
the different approaches developed by Samtani 45 have been 
adapted to the CDR-SOB score. 

RESULTS 
Available data 

Model building was performed on data obtained from the 
ADNI database (www.adni.loni.ucla.edu). 10 The final analysis 
dataset consisted of 2,700 CDR-SOB values collected from 
380 MCI and 180 AD patients for up to 4 years. It excluded 
control subjects for which, contrary to ADAS-cog scores, most 
CDR-SOB scores were equal or close to zero (Figure 2a,b), 
as well as subjects with a single CDR-SOB record. Guided by 
prior disease modeling in this area, a total of 19 covariates 
were included (see Methods). As cerebrospinal fluid (CSF) 
biomarkers were only available in about half of the patients, 
their impact could not be fully assessed. 

Special attention has been given to the HIPV which is 
known to be an important covariate in AD. 11 * 12 HIPV has been 
shown to be affected by head size, age, and sex 13 and to sig- 
nificantly drop in the elderly. 14 Therefore, its standardization to 
individual characteristics should improve its disease predic- 
tive value. 15 So, in addition to the observed HIPV centered 
to the median value of healthy population, a HIPV normal- 
ized to that of a healthy subject with the same age and head 
size (RHPNM) has been derived for each MCI and AD patient. 
The normalization was based on the relationship between 
HIPVs, individual estimated intracranial volumes, 16 and ages 
in healthy subjects (see Methods) and was used to compare 
the HIPV atrophy between patients. It should be noted that 
sex was no longer necessary in this normalization because 
it was already included in estimated intracranial volumes. 
As expected and shown in Figure 2c,d, this transformation 
decreased the variance of the HIPV measurement by about 
one-third. 

Structural base model development 

As previously described for ADAS-cog, 45 graphical analysis 
of CDR-SOB progressions indicated a continuous increase 
in disease progression rate over time in most patients, the 
higher the CDR-SOB score the faster the progression rate. 
Like ADAS-cog, CDR-SOB score is also constrained between 
lower and upper limits (here, 0-18) and in particular, left cen- 
sored (Figure 2a,b). 

As a starting model, we selected a nonlinear model 
adapted from Samtani 4 based on differential equations with 
an evolving disease progression rate. As subjects entered 



the study at different stages of the disease, a disease-onset 
time (DOT) similar to the time shift introduced by Yang 6 was 
also applied: 
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When time (7) equaled DOT, an increase in >A(1), a 
continuous variable related to CDR-SOB, was triggered (i.e., 
by (T 30 /(DOT 30 +T 30 )) which due to the power arbitrary set to 30 
approximated a step function from 0 to 1). The change in >A(1) 
was described by a constant disease progression rate (RATE) 
plus an additive term (>A(1) x a) in which a was a parameter 
for the individual change in progression rate. To deal with floor 
and ceiling CDR-SOB scores, the modeling was performed in 
the logit domain and additive residual error was used. There- 
fore, >A(1) represents the time course of CDR-SOB in the logit 
domain. Inherent to the nature of the model, at least one covari- 
ate indicative of the patient's status was required. The most 
appropriate one was the cognitive CDR-SOB score at study 
entry since it carried most of the information on the patient dis- 
ease status and DOT (i.e., the higher the score the earlier the 
disease started). It should also be noted that due to numeri- 
cal difficulties, log normally distributed interindividual variability 
(I IV) could only be implemented on one of the two parameters, 
RATE or DOT, forcing either the same RATE or the same DOT 
for every subject. The model was stable when implementing I IV 
on parameter DOT. 

Therefore, for a CDR-SOB score at study entry and its 
progression as a function of time, the modeling exercise 
essentially consisted of identifying a DOT for each individual 
that minimized the objective function given the population 
disease trajectory. The combination of DOT synchronization 
and population analysis — information from one individual 
enriched by the information coming from the other individu- 
als — allowed the estimation of the most likely disease trajec- 
tory of the CDR-SOB score. 

However, when applying this model, two major observa- 
tions were noted. First, observed disease scores evolved more 
slowly in a significant number of subjects, mainly belonging to 
the group classified as MCI. Second, CDR-SOB scores follow- 
ing study entry showed an early drop or delay before progres- 
sion of the disease. These two observations were in agreement 
with the previous findings 517 when modeling ADAS-cog scores. 

To allow the model to capture the difference in the disease 
progression rate, a mixture model was implemented allow- 
ing to assign subjects to one out of the two subpopulations 
($MIX). 18 For the first subpopulation, RATE was estimated 
without II V and a set to 0, whereas for the second sub- 
population, RATE without I IV and a with I IV were estimated 
together. Subjects were assigned to either subpopulation 
independently of their disease status (i.e., MCI and AD sta- 
tus was not used as a covariate). The second observation 
was accounted for by adding a 'placebo' effect at the time the 
patient entered the study as given by the following equation 
where CDR_SOB represents the predicted CDR-SOB score, 
PL the magnitude of the 'placebo' effect, and KPL the equili- 
bration rate constant of the effect: 
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Figure 1 Scale synchronization on disease onset time, (a) Typical clinical dementia rating scale — sum of boxes score profiles in normal 
(NL), mild cognitive impairment (MCI), and Alzheimer's disease (AD) subjects from AD neuroimaging initiative, (b) Subpopulation time scale 
adjustment based on the hypothesis of common disease trajectory, (c) Individual back (AD to MCI) and forward (MCI to AD) scale adjustments 
by estimation of the disease onset time (DOT), (d) Synchronization on DOT instead of time of study entry. 




Figure 2 Clinical dementia rating scale-sum of boxes and hippocampal volume vs. status at study entry, (a) Relationship between clinical 
dementia rating scale-sum of boxes (CDR-SOB) and Alzheimer's disease assessment scale-cognitive subscale at study entry and (b) CDR- 
SOB change from baseline at 2 years in function of baseline values at study entry for the different diagnostic groups. Lines are smooth through 
all the data, (c) Distribution of hippocampal volumes at study entry centered to median value of controls or (d) normalized to healthy values 
for same age and head size (RHPNM) in function of Alzheimer's disease status. 
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CDR_SOB-PLx(1-EXP(-KPLxT)) (2) 

Finally, in addition to the I IV on DOT and a, the score-time 
profile was best captured by log normally distributed II V on PL; 
the estimation of I IV on KPL was not supported by the data. 

Covariate analysis 

Covariate analyses presented hereunder pursued two aims. 
The first one was to find among available biomarkers those 
that could best explain the variability in disease progres- 
sion, described in this model by DOT and a parameters, and 
the second aim was to identify biomarkers that could allow 
the discrimination between slow and fast MCI progressers. 

Base model. As mentioned previously, the primary covariate 
that needed to be accounted for was CDR-SOB at study entry, 
put on DOT. Next, covariates such as baseline ADAS-cog, hip- 
pocampal volume, mini mental score exam (MMSE), and func- 
tional assessment questionnaire (FAQ), preselected mainly by 
graphical analysis (i.e., correlation with DOT) and clinical signif- 
icance were also tested on DOT as described in Table 1 (part I). 



ADAS-cog was retained since it decreased the objective func- 
tion the most (100 units). None of the other tested covariates 
were found statistically significant after selection of CDR-SOB 
and ADAS-cog. This model was considered as the base model 
(Table 2, left part) and was used to search for potential covari- 
ates for slow and fast MCI progressers. At that stage, tentative 
implementation of covariates on parameter a was explored but 
always resulted in numerically instable models. 

Slow- and fast-progressing MCI populations. Effect of 
covariates to identify slow- and fast-progressing MCI pop- 
ulations was explored using generalized additive models 
(GAM) in univariate and multivariate steps. First, all covari- 
ates (i.e., in total 19) were tested separately. As shown in 
Figure 3a, sex and APOE e4 carrier status were not iden- 
tified by univariate analysis. Conversion from MCI to AD 
appeared indicative of fast progression since 84% (136 of 
162) of fast progressers had converted although 33% (69 
of 207) of not-yet-converters were also identified as fast 
progressers by the model. Interestingly but not surprisingly, 
use of co-medication was also indicative of fast disease 
progression. Second, an automated multivariate step-GAM 



Table 1 Summary of model development 



AOF relative 



AOF relative to 
model before 
covariate 



Run 3 


Covariates 


Covariate relationships 


OF 


to start model 


addition/deletion 


Part I: Covariate implementation 15 on disease onset time (DOT) 








Start 


CDR-SOB at study entry 


DOT = 0 1 x (CDR bs /2) 66 


3,265.550 






Addition 


MMSE at study entry 


DOT = 0 1 x (CDR bs| /2) 66 x 
(MMSE bs| /26) 910 


3,175.575 


-89.975 


-89.975 


Base 


ADAS-cog at study entry 


DOT = 0 1 x (CDR bs| /2) 96 x 
(ADAS bs| /12.67) e1 ° S 


3,165.421 


-100.129 


-100.129 


Addition 


RHPNM C at study entry 


DOT = G 1 x (CDR bs| /2) 96 x 
(RHPNM) 610 


3,199.509 


-66.041 


-66.041 


Part II: covariate implementation of mixture model as follows: P1<^ = LOG(0 5 /(1-0 5 )) and 
P1 = EXP(P1(()+COV1+COV2+...)/(1+EXP(P1^+COV+COV2+...)) with 








Addition 


RHPNM at study entry 


COV1 =e„ x(RHPNM-1) 


3,093.269 


-172.281 


-72.152 


Addition 


CDR-SOB at study entry 


COV1=e ilX (CDR bs| -1) 


2,986.574 


-278.976 


-178.847 


Addition 


FAQ at study entry 


COV1=9 11 x(FAQ bs| -1) 


2,990.540 


-275.01 


-174.881 


Addition 


CDR-SOB and FAQ at 
study entry 


COV1 =e i1 x(CDR bsl -1) 
COV2 = 0 12 x(FAQ bs| -1) 


2,950.756 


-314.794 


-35.818 


Addition 


CDR-SOB and RHPNM at 
study entry 


COV1 =G 11 x(CDR bs| -1) 
COV2 = 0 12 x(RHPNM-1) 


2,951.839 


-313.711 


-34.735 


Addition 


CDR-SOB, FAQ and RHPNM 
at study entry 


COV1= G^xfCDFVI) 
COV2 = 9 12 x(FAQ bs| -1) 
COV3 = 9 13 x(RHPNM-1) 


2,923.001 


-342.549 


-27.755 


Deletion 


RHPNM and FAQ at study 
entry 


COV1 =0^ x(RHPNM-1) 
COV2 = 0 12 x(FAQ bs| -1) 


2,962.422 


-303.128 


39.421 


Part III: Covariate implementation on a 










Addition 


RHPNM at study entry 


«=9 3 x (RHPNM) 914 


2,916.804 


-348.746 


-10.516 


Addition 


ADAS-cog at study entry 


«=9 3 x (ADASbsl/12.67) 614 


2,912.485 


-353.065 


-6.197 


Final 


MMSE at study entry 


a=0 3 x(MMSE bs| /26) e14 


2,903.596 


-361.954 


-19.405 



ADAS-cog, Alzheimer's disease assessment scale-cognitive subscale; CDR-SOB, clinical dementia rating scale — sum of boxes; DOT, disease onset time; FAQ, 
functional assessment questionnaire; MMSE, mini mental score exam; OF, objective function. 

a Runs in italic were not retained. b Covariates were centered on the median value of the dataset. individual estimation of hippocampal volume atrophy (HIPV/ 
HPNM) as described in methods in Alzheimer's disease neuroimaging initiative data extraction and assembly. 
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Table 2 Population parameter estimates 





Base model without covariate on $MIX (OF: 3,165.421) 


Final model with covariates on $MIX (OF: 2,903.596) 


IVIUUCI |JC1I CI 1 1 ICLC 1 


Estimate 


CV (%) a 


IIV (%) b CV (%) a 


Estimate 


CV (%) a 


IIV (%) b CV (%) a 


Fa^t rli^pa^p nrnnrp^inn ratp 

i cio l uiocaoc pi uyi cooiui i i ciiv_7, 

1/year 


0.383 


4.7 




0.373 


5.4 




Slow disease progression rate, 
1/year 


0.271 


8.7 




0.26 


9.8 




DOT, year 


16.3 


2.1 


2.0 38 


16.1 


2.9 


1.5 61 


DOT-20, years 


-3.7 


(-3.0)-(-4.4) c 




-3.9 


(-3.0)-(-4.8) c 




COV CDR-SOB on DOT 


-0.0807 


8.3 




-0.072 


8.3 




COV ADAS on DOT 


-0.0532 


15 




-0.0439 


20 




Multiplicative term (a) 


0.0483 


17.0 


73 23 


0.0499 


15.9 


64 25 


Baseline correction (BLC) 


4.43 


2.8 




4.48 


3.9 




Placebo magnitude (PL) 


0.436 


3.1 


83 13 


0.434 


11 


86 18 


Placebo rate (KPL), 1/year 


1 






1 






MCI/AD slow {a =0) 


44/4 






44/3 






COV MMSE on a 








-2.01 


29 




COV CDR-SOB on $MIX 








-1.27 


19.9 




COV FAQ on $MIX 








-0.341 


31.7 




COV RHPNM on $MIX 








7.5 


30.3 




RES Error (SD) 


0.375 


4.7 




0.377 


4.8 





ADAS, Alzheimer's disease assessment scale; CDR-SOB, clinical dementia rating scale — sum of boxes; DOT, disease onset time; FAQ, functional assessment 

questionnaire; MMSE, mini mental score exam; OF, objective function. 

Precision on model parameter estimate. b lnterindividual variability. c 95% confidence interval. 



analysis with forward selection and backward deletion was 
performed using relevant covariates from the univariate 
tests that were available in almost all MCI patients, i.e., 
MMSE, ADAS-cog, FAQ, Trail B test, CDR-SOB, ventricular, 
and hippocampal volumes. Sex and APOE e4 carrier status 
were also tested again. From this multivariate step-GAM 
analysis, the most significant covariates to differentiate 
between slow and fast MCI progressers were CDR-SOB (P 
= 8.7x1 0" 6 ), FAQ (P = 1 .85 x 1 0" 5 ), and RHPNM (P = 4 x 
10 -4 ). Sex was also identified but was less significant (P = 
0.026). APOE e4 carrier status was not identified. 

As mentioned earlier, CSFtau, p-tau 181p , and Ap1-42 lev- 
els, biomarkers well known to be altered in AD, 19 were only 
available in a subset of MCI patients (Figure 3a) and there- 
fore were not included in the multivariate GAM analysis. 
However, in addition to the univariate analysis, a graphical 
analysis indicated a possible effect of CSF Ap1-42 in dis- 
criminating fast from slow-progressing MCI subjects. 

Final model development 

The three major covariates selected by the multivariate GAM 
analysis were implemented in NONMEM by estimating their 
effect on the modeled fraction of the population in the first 
(or second) subpopulation ($MIX) 16 and further analyzed as 
described in Table 1 (right part). All three, (CDR-SOB, FAQ, 
and RHPNM) were found to significantly improve the model 
objective function of the base model (AOF > 200). A final 
search of covariates for their potential influence on parame- 
ter a was undertaken as described in part III of Table 1 and 
led to the inclusion of the MMSE score. In the resulting final 
model, all included covariates were statistically significant 



(P < 0.001); population parameter estimates are given in 
Table 2 (right part) in comparison with the base model. 

Model evaluation 

The goodness of fit plots (not shown) were carefully exam- 
ined and used together with the minimization of the objective 
function as guides throughout all the model development. 
Visual predictive checks are shown in Figure 4 for base and 
final models. As shown in this figure, both models were able 
to satisfactorily predict the course of the disease progression 
in the different diagnosed groups. The base model performed 
slightly better for AD patients and the final model for fast MCI 
progressers, particularly for the fastest ones. 

Results of GAM analyses for the slow and fast MCI pop- 
ulations were also evaluated for both models by applying 
the logistic models to all subjects from the ADNI database 
with the appropriate covariates as shown in Figure 3b,c. 
As shown in this figure, predictions made on GAM-selected 
covariates allowed to reasonably differentiate subjects rela- 
tive to their probability of disease progression and were in 
good agreement with ADNI classification. Indeed, the NL and 
AD subjects who were not part of the GAM analysis of slow 
and fast MCI subjects could be well categorized based on 
their covariates, for their probability of progression. 

DISCUSSION 

Considering AD as a continuously progressing disease, 
CDR-SOB scores from MCI and AD patients from the ADNI 
database have been used in a combined analysis using 
DOT synchronization in order to reconstruct a coherent 
trajectory for disease progression. DOT and the disease 
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POPIT S(CDR, 3) + s(FAQ, 2) + RHPNM + MMSE + TRAB + SEX 
ANOVA (n = 366) 



POPIT FAQ + RHPNM + S(CDR, 3) + TRAB 
ANOVA (n = 369) 



.2 0.8 



^ 0.6 



It o.4 



0.0 



Deletion P value 



CDR 8.72x10" c 

FAQ 1.86x10" 

RHPNM 0.00040 

MMSE 0.00543 

TRAB 0.01650 
SEX 0.029 



I 



I 
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2? 0.4 - 



Deletion P value * . ■ m 
FAQ 4.22 x10" 10 ' 
RHPNM 6.26 x10" 9 j 
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Figure 3 Probability of fast progression, (a) Univariate generalized additive models (GAM) analysis on mild cognitive impairment (MCI) slow 
(bottom side) of and fast (top side) progressers for, from left to right, sex (1 = male; 2 = female), apolipoprotein e4 (0 = noncarrier; 1 = carrier), 
MCI to Alzheimer's disease (AD) conversion (0 = no; 3 = yes), comedication (0 = no anticholinesterase; 1 = with anticholinesterase), age, 
cholesterol, cerebrospinal fluid A(31-42, Tau (log scale), p-tau 181p (log scale), and p-tau 181p /A|31-42(log scale), (b) Probability of fast disease 
progression based on MCI slow/fast GAM analyses according to base or (c) final model. In this latter, the five slow AD disease patients are 
represented by green-dotted lines. 



trajectory were implemented in a differential equation. At the 
time the disease started in an individual, the estimated DOT 
activated the increase in the CDR-SOB score following a 
RATE adjusted to each subject's progression velocity by an 
additive disease increasing rate term (CDR x a). Initially to 
deal with the floor and ceiling effect of the score, modeling 
was performed in the logit domain. However, this approach 
also implies that the disease progression itself occurs in 
the logit domain. In fact, a score is only an expression of 
a disease status and is limited to a time window when it 
is sensitive to the disease progression. For instance, the 
disease can have started a while ago, but the score is not 
yet sensitive enough to detect its progression (e.g., CDR- 
SOB score below 0.5). On the opposite, the disease can 
still evolve but the score can no more describe its progres- 
sion because it has already reached the maximum value 
(e.g., CDR-SOB score of 18). If we accept that the disease 
progresses in the logit domain, the different scores (e.g., 
ADAS-cog, CDR-SOB, MMSE, FAQ, etc) can be positioned 



at different phase of the disease progression and can trans- 
late the disease progression rate through different link func- 
tions. Unfortunately, today, the 'true' or reference disease 
status and trajectory have not yet been defined. Imaging 
techniques might help in this quest. This makes that >A(1) 
in the disease trajectory equation is not the 'true' disease 
status and is mainly driven by the score used in the model- 
ing, i.e., CDR-SOB. It can also be mentioned that even in 
the logit domain, the progression of the score could not be 
modeled by a straight line and required a nonlinear function. 
This is due to an asymmetry in the score or/and its progres- 
sion as a function of time. Finally, the use of a differential 
equation to describe the trajectory was justified by the flex- 
ibility it offers in the future to describe different drug actions 
on disease progression. 

With this model, it was identified that the disease pro- 
gression evolved significantly more slowly in a number of 
MCI subjects. To capture this difference in disease trajec- 
tories, a mixture model was implemented. The time shift 
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Figure 4 Model visual predictive check. Visual predictive checks for the base (left side) and final (right side) Alzheimer's disease (AD) 
progression models. Red lines are the 10th, 50th, and 90th progressions of clinical dementia rating scale — sum of boxes (CDR-SOB) from 
the AD neuroimaging initiative trial whereas dots are the individual observations. Green areas represent the 10th, 50th, and 90th percentiles 
of the predicted CDR-SOB progressions from the 100 simulated datasets. 
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Figure 5 Hippocampal volume-time profiles, (a) Evolution of the hippocampal volumes during the study for each status, (b) Relationship 
between hippocampal volumes centered to median of the normal population and model estimated time since disease onset (DOT), (c) 
Relationship between normalized hippocampal volumes to control values for same age and head size (estimated intracranial volumes) and 
DOT. Lines are smooth through the data. 



approach has already been applied by Yang etal. on ADAS- 
cog scores. 6 However, in our case, the model was not able 
to align all patients according to one trajectory but rather 
identified statistically two populations, based on fast or slow 
progression in the CDR-SOB score. As expected, most of 
the patients from the AD group (97%) were identified by 



the model as fast-progressing subjects whereas the slow- 
progressing population was essentially formed by the 
patients from the MCI group (44%), indicating that these 
patients did not transit to AD status during the observation 
period. This is in agreement with the segregation of MCI 
patients into two subpopulations described by Samtani. 5 
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Identification of fast-progressing and slow-progressing MCI 
highlights an important caveat to the analysis of Yang etal. 6 
in which ADAS-cog 13 is used to synchronize time trajec- 
tories across three different populations. The logic of that 
analysis would be sound if the MCI population was simply 
a more progressed version of the control population and 
the AD population were just a more progressed version of 
the MCI population. That, however, is not the case: the AD 
population is both a more progressed and a highly selected 
(by virtue of the study design) version of the MCI popula- 
tion. Because of this selection, it is not the case that, given 
enough time, the MCI population would eventually be similar 
to the AD population. This has also an impact on the estima- 
tion on the DOT. 

The present analysis can be considered as an additional 
step in the sequential development of AD progression mod- 
els. In our model, all the trajectories of CDR-SOB scores were 
defined by individual DOTs and a rate, which could progress 
slowly in slow-progressing subjects, or faster with more or 
less acceleration as the disease evolved in fast-progressing 
subjects. In addition, the disease trajectories were completed 
by a 'placebo component' to take into account the transient 
slight improvement or delay in the score progression observed 
in numerous patients following study enrolment. Apart from 
a placebo effect, this drop in CDR-SOB scores may also 
be interpreted as learning effect but could result from other 
study-specific effects (inclusion criteria and concomitant drug 
effect). The decrease in CDR-SOB scores was a challeng- 
ing aspect of the model development, since it could confound 
other aspects of disease progression. The way it was modeled 
allowed taking this effect into account without compromising 
other aspects of the disease progression model. However, 
the fact that the placebo effect was introduced after logit back 
transformation might produce negative scores in a simulation 
mode. Since the score was digitalized to 0, 0.5, 1 , 1 .5, etc, no 
negative scores were produced in the simulations (e.g., visual 
predictive checks). 

CDR-SOB and ADAS-cog scores were identified as 
covariates for DOT and MMSE as covariate on the disease- 
increasing rate term. It should be noted that the covariate 
search only focused on biomarkers available in most of the 
patients; therefore, the impact of CSF p-tau 181p and Ap1-42 
which were only available in half of the subjects in ADNI was 
not fully explored in this analysis. The potential influence of 
CSF p-tau 181p and Ap1-42 should be further tested with addi- 
tional longitudinal CSF and clinical data. 

Covariates identified for assignment to the slow- or fast- 
progressing MCI groups at study entry were CDR-SOB, 
FAQ, and the hippocampal volume normalized for age and 
head size. Notably, without normalization, HIPV was only 
just significant (P = 0.02). Implementation of these bio- 
markers as covariates of the mixture model significantly 
improved the model (AOF > 200) and patient stratifica- 
tion. On the basis of these prognostic factors, 81% of the 
subjects could correctly be assigned to the slow or fast- 
progressing subpopulations and, assuming that fast pro- 
gresses will convert, 77% of the MCI to AD conversion 
could be predicted. Notably, the disease progression model 
described correctly 84% of the conversions (see Supple- 
mentary Data online). These biomarkers have also been 



identified by other authors as important for status defini- 
tion, 8 progression rate, 10 and MCI to AD conversion. 20 Of 
note, they combine a cognitive score with a functionality 
score and brain anatomy. Therefore, the use of these bio- 
markers to calculate the probability of fast disease progres- 
sion should improve the clinical diagnosis and prognosis 
of AD. 

The estimation of the DOT allowed a better positioning of 
each individual in his disease trajectory at study entry. The 
DOT estimated by the CDR-SOB model could be applied to the 
time profiles of biomarkers. The application of this concept has 
already been introduced by Yang. 6 It is illustrated for our analy- 
sis in Figure 5 in which the hippocampal volume time profiles 
have been synchronized on the DOT. This approach virtually 
expands the clinical observation period from 3 to 8 years and 
provides insights into long-term changes in the biomarkers. 

In conclusion, the use of the DOT and disease trajectory 
concepts was powerful for detecting different AD progres- 
sion rates in the ADNI population and identifying corre- 
sponding prognostic factors. Estimation of the DOT by the 
CDR-SOB model allowed the synchronization of biomarker- 
time profiles on disease onset rather than on study entry 
and provided insights in long-term changes in biomarkers. 
From this analysis, the CDR-SOB score could be considered 
as complementary to the ADAS-cog score from a modeling 
and simulation perspective for evaluating disease-modifying 
drugs in prodromal subjects. 

METHODS 

ADNI data extraction and assembly. Data used in this arti- 
cle were obtained from the ADNI database (adni.loni.ucla. 
edu). The ADNI was launched in 2003 by the National Insti- 
tute on Aging, the National Institute of Biomedical Imaging 
and Bioengineering, the US Food and Drug Administration, 
private pharmaceutical companies, and nonprofit organiza- 
tions. The primary goal of ADNI has been to test whether 
serial magnetic resonance imaging, positron emission 
tomography, other biological markers, and clinical and 
neuropsychological assessment can be combined to mea- 
sure the progression of MCI and early AD. The Principal 
Investigator of this initiative is M.W.W., VA Medical Center 
and University of California — San Francisco, with efforts 
of many coinvestigators from a broad range of academic 
institutions and private corporations. Subjects have been 
enrolled from over 50 sites across the USA and Canada. 
For up-to-date information, see www.adni-info.org. 

Following approval to access ADNI, original data sets were 
downloaded on 1 August 201 1 . At that time, ADNI database 
consisted of 819 adults, aged 55-91 years, with CDR-SOB 
records for an observation period up to 4 years: 229 sub- 
jects were classified as NL, 397 as MCI, and 193 as AD at 
enrollment. Biomarker assessments were recorded at 0, 6, 
12, 24, 36, and 48 months with an additional evaluation at 
18 months for the MCI group. During the observation period, 
166 MCI converted to AD, 6 AD converted to MCI, and 19 NL 
evolved to MCI whom 3 of which subsequently evolved to AD. 

Intrinsically, the model considered that control subjects 
had CDR-SOB scores of zero which was in agreement 
with the observations. Therefore, control subjects were not 
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included in the final NONMEM dataset for the CDR-SOB 
analysis since they did not carry information to the model. 
Patients with a single CDR-SOB record (16 MCI and 13 
AD) were also removed. Covariates investigated were age, 
sex, serum cholesterol, APOE e4 carrier status, hippocam- 
pal, ventricular and estimated intracranial volumes, FAQ, 
Trail B test, MMSE and ADAS-cog (total 11) scores, CSF 
Tau, p-tau 181p and Ap1-42, plasma Ap1-42 and Ap1-40, 
MCI to AD conversion, and medication for cognitive dis- 
order (CCMED). The latter was registered as categorical 
covariates (0, 1) and positive when at least one anticho- 
linesterase drug was recorded. Values at study enrollment 
were utilized. HIPV was the average of left and right HIPV 
as used by Samtani. 4 For covariate model building, median 
covariate value of the diagnostic group was imputed for 
missing covariate when covariate was nearly complete. 
For GAM analyses, subjects with missing relevant covari- 
ates were excluded. The HIPV of the subject at study entry 
(HIPVbsL) was normalized to the HIPV of a healthy subject 
with same head size and age (HPNMbsL) to obtain an esti- 
mation of the HIPV atrophy of the patient (RHPNMbsL) at 
study entry as follows: 



RHPNMbsL 



HlPVbsl, 
HPNMbsL ' 



where HPNMbsL = Age i x (-26.6268 + EICVbsL x 0.0016 + 
3340.4395). The calculation was based on regression analy- 
sis between HIPV, age, and estimated intracranial volumes 
performed in healthy subjects; the estimated intracranial vol- 
ume being the best substitute for head size found in the ADNI 
database. 

Model building and evaluation. Data were analyzed by non- 
linear mixed effects modeling in NONMEM, version 7.2. 0. 21 
The first-order conditional estimation method was used. 
Technical details about the NONMEM implementation of the 
model are given in the Supplementary Data online. 

Influences of covariates were evaluated as possible 
explanatory variables of I IV in model parameters and for sub- 
populations stratification in $MIX and included in the model 
as shown in Table 2. The covariates were selected based on 
the change in objective function. 

Models of interest were implemented in the trial simulator 
TS2 version 2.1.2 (Pharsight, Mountain View, CA). Simula- 
tions were performed based on the population NONMEM 
parameter estimates and bootstrap of covariates from the 
original dataset. Visual predictive checks to evaluate the pre- 
dictive ability of the models were based on 100 simulated 
datasets. S-PLUS 6.2 (Insightful Corporation, Seattle, WA) 
was used for data management, statistical analysis, and gen- 
eration of graphic outputs. 

Uni- and multivariate GAM analyses on slow and fast MCI. 
Slow and fast MCI were analyzed as binary variables using 
the GAM in which the effect of available biomarkers was 
examined as prognostic factors, separately or in combi- 
nation (uni- or multivariate GAM analysis). 22 Multivariate 
GAMs were built using the automated step-wise search 



developed in S-PLUS (version 6.2; Insightful Corporation, 
Seattle, WA). The automated step-wise search selects the 
best GAM using alternating forward selection and backward 
deletion given the range of models. A series of candidate 
relationships (e.g., linear, log transformation, spline, and 
Loess smooth) that describe how each particular prognos- 
tic factor might enter the model is defined for every prog- 
nostic factor. The final models were built by evaluating all 
candidate forms for each prognostic factor in a step-wise 
manner. 
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Study Highlights 

WHAT IS THE CURRENT KNOWLEDGE ON THE 
TOPIC? 

y Despite numerous ADAS-cog disease progres- 
sion and drug models, prediction of MCI to AD 
conversions remains challenging. 

WHAT QUESTION DID THIS STUDY ADDRESS? 

y Could the disease onset time and disease tra- 
jectory concepts help in the understanding of 
AD progression and provide better prognosis of 
disease progression? 

WHAT THIS STUDY ADDS TO OUR KNOWLEDGE 

y This analysis allows identification of MCI sub- 
populations and covariates based on slow/fast 
disease progression rate. It documents the use 
of CDR-SOB score as a possible primary end- 
point for disease-modifying drugs in prodromal 
subjects. It also allows insight into biomarker- 
time profiles over a period of about 8 years com- 
pared with the actual 3-year observation period. 

HOW THIS MIGHT CHANGE CLINICAL 
PHARMACOLOGY AND THERAPEUTICS 

1/ By treating the disease as a continuous progres- 
sion, the disease onset time synchronization 
AD model allows disease evolution predictions, 
patients categorization based on covariates, 
and can improve evaluation of new therapeutics 
on disease progression. This analysis also illus- 
trates the use of the disease onset time syn- 
chronization concept which can be applied to 
many other disease progression models. 
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